Data pipelines in a public health emergency: The human in the machine.

In an emergency epidemic response, data providers supply data on a best-faith effort to modellers and analysts who are typically the end user of data collected for other primary purposes such as to inform patient care. Thus, modellers who analyse secondary data have limited ability to influence what is captured. During an emergency response, models themselves are often under constant development and require both stability in their data inputs and flexibility to incorporate new inputs as novel data sources become available. This dynamic landscape is challenging to work with. Here we outline a data pipeline used in the ongoing COVID-19 response in the UK that aims to address these issues. A data pipeline is a sequence of steps to carry the raw data through to a processed and useable model input, along with the appropriate metadata and context. In ours, each data type had an individual processing report, designed to produce outputs that could be easily combined and used downstream. Automated checks were in-built and added as new pathologies emerged. These cleaned outputs were collated at different geographic levels to provide standardised datasets. Finally, a human validation step was an essential component of the analysis pathway and permitted more nuanced issues to be captured. This framework allowed the pipeline to grow in complexity and volume and facilitated the diverse range of modelling approaches employed by researchers. Additionally, every report or modelling output could be traced back to the specific data version that informed it ensuring reproducibility of results. Our approach has been used to facilitate fast-paced analysis and has evolved over time. Our framework and its aspirations are applicable to many settings beyond COVID-19 data, for example for other outbreaks such as Ebola, or where routine and regular analyses are required.

Quantifying the effect of delaying the second COVID-19 vaccine dose in England: a mathematical modelling study.

BACKGROUND: The UK was the first country to start national COVID-19 vaccination programmes, initially administering doses 3 weeks apart. However, early evidence of high vaccine effectiveness after the first dose and the emergence of the SARS-CoV-2 alpha variant prompted the UK to extend the interval between doses to 12 weeks. In this study, we aimed to quantify the effect of delaying the second vaccine dose in England. METHODS: We used a previously described model of SARS-CoV-2 transmission, calibrated to COVID-19 surveillance data from England, including hospital admissions, hospital occupancy, seroprevalence data, and population-level PCR testing data, using a Bayesian evidence-synthesis framework. We modelled and compared the epidemic trajectory in the counterfactual scenario in which vaccine doses were administered 3 weeks apart against the real reported vaccine roll-out schedule of 12 weeks. We estimated and compared the resulting numbers of daily infections, hospital admissions, and deaths. In sensitivity analyses, we investigated scenarios spanning a range of vaccine effectiveness and waning assumptions. FINDINGS: In the period from Dec 8, 2020, to Sept 13, 2021, the number of individuals who received a first vaccine dose was higher under the 12-week strategy than the 3-week strategy. For this period, we estimated that delaying the interval between the first and second COVID-19 vaccine doses from 3 to 12 weeks averted a median (calculated as the median of the posterior sample) of 58 000 COVID-19 hospital admissions (291 000 cumulative hospitalisations [95% credible interval 275 000-319 000] under the 3-week strategy vs 233 000 [229 000-238 000] under the 12-week strategy) and 10 100 deaths (64 800 deaths [60 200-68 900] vs 54 700 [52 800-55 600]). Similarly, we estimated that the 3-week strategy would have resulted in more infections compared with the 12-week strategy. Across all sensitivity analyses the 3-week strategy resulted in a greater number of hospital admissions. In results by age group, the 12-week strategy led to more hospitalisations and deaths in older people in spring 2021, but fewer following the emergence of the delta variant during summer 2021. INTERPRETATION: England's delayed-second-dose vaccination strategy was informed by early real-world data on vaccine effectiveness in the context of limited vaccine supplies in a growing epidemic. Our study shows that rapidly providing partial (single-dose) vaccine-induced protection to a larger proportion of the population was successful in reducing the burden of COVID-19 hospitalisations and deaths overall. FUNDING: UK National Institute for Health Research; UK Medical Research Council; Community Jameel; Wellcome Trust; UK Foreign, Commonwealth and Development Office; Australian National Health and Medical Research Council; and EU.

Clinical Characteristics and Predictors of Outcomes of Hospitalized Patients With Coronavirus Disease 2019 in a Multiethnic London National Health Service Trust: A Retrospective Cohort Study.

BACKGROUND: Emerging evidence suggests ethnic minorities are disproportionately affected by coronavirus disease 2019 (COVID-19). Detailed clinical analyses of multicultural hospitalized patient cohorts remain largely undescribed. METHODS: We performed regression, survival, and cumulative competing risk analyses to evaluate factors associated with mortality in patients admitted for COVID-19 in 3 large London hospitals between 25 February and 5 April, censored as of 1 May 2020. RESULTS: Of 614 patients (median age, 69 [interquartile range, 25] years) and 62% male), 381 (62%) were discharged alive, 178 (29%) died, and 55 (9%) remained hospitalized at censoring. Severe hypoxemia (adjusted odds ratio [aOR], 4.25 [95% confidence interval {CI}, 2.36-7.64]), leukocytosis (aOR, 2.35 [95% CI, 1.35-4.11]), thrombocytopenia (aOR [1.01, 95% CI, 1.00-1.01], increase per 109 decrease), severe renal impairment (aOR, 5.14 [95% CI, 2.65-9.97]), and low albumin (aOR, 1.06 [95% CI, 1.02-1.09], increase per gram decrease) were associated with death. Forty percent (n = 244) were from black, Asian, and other minority ethnic (BAME) groups, 38% (n = 235) were white, and ethnicity was unknown for 22% (n = 135). BAME patients were younger and had fewer comorbidities. Although the unadjusted odds of death did not differ by ethnicity, when adjusting for age, sex, and comorbidities, black patients were at higher odds of death compared to whites (aOR, 1.69 [95% CI, 1.00-2.86]). This association was stronger when further adjusting for admission severity (aOR, 1.85 [95% CI, 1.06-3.24]). CONCLUSIONS: BAME patients were overrepresented in our cohort; when accounting for demographic and clinical profile of admission, black patients were at increased odds of death. Further research is needed into biologic drivers of differences in COVID-19 outcomes by ethnicity.

Reproducible parallel inference and simulation of stochastic state space models using odin, dust, and mcstate.

State space models, including compartmental models, are used to model physical, biological and social phenomena in a broad range of scientific fields. A common way of representing the underlying processes in these models is as a system of stochastic processes which can be simulated forwards in time. Inference of model parameters based on observed time-series data can then be performed using sequential Monte Carlo techniques. However, using these methods for routine inference problems can be made difficult due to various engineering considerations: allowing model design to change in response to new data and ideas, writing model code which is highly performant, and incorporating all of this with up-to-date statistical techniques. Here, we describe a suite of packages in the R programming language designed to streamline the design and deployment of state space models, targeted at infectious disease modellers but suitable for other domains. Users describe their model in a familiar domain-specific language, which is converted into parallelised C++ code. A fast, parallel, reproducible random number generator is then used to run large numbers of model simulations in an efficient manner. We also provide standard inference and prediction routines, though the model simulator can be used directly if these do not meet the user's needs. These packages provide guarantees on reproducibility and performance, allowing the user to focus on the model itself, rather than the underlying computation. The ability to automatically generate high-performance code that would be tedious and time-consuming to write and verify manually, particularly when adding further structure to compartments, is crucial for infectious disease modellers. Our packages have been critical to the development cycle of our ongoing real-time modelling efforts in the COVID-19 pandemic, and have the potential to do the same for models used in a number of different domains.

Non-pharmaceutical interventions, vaccination, and the SARS-CoV-2 delta variant in England: a mathematical modelling study.

BACKGROUND: England's COVID-19 roadmap out of lockdown policy set out the timeline and conditions for the stepwise lifting of non-pharmaceutical interventions (NPIs) as vaccination roll-out continued, with step one starting on March 8, 2021. In this study, we assess the roadmap, the impact of the delta (B.1.617.2) variant of SARS-CoV-2, and potential future epidemic trajectories. METHODS: This mathematical modelling study was done to assess the UK Government's four-step process to easing lockdown restrictions in England, UK. We extended a previously described model of SARS-CoV-2 transmission to incorporate vaccination and multi-strain dynamics to explicitly capture the emergence of the delta variant. We calibrated the model to English surveillance data, including hospital admissions, hospital occupancy, seroprevalence data, and population-level PCR testing data using a Bayesian evidence synthesis framework, then modelled the potential trajectory of the epidemic for a range of different schedules for relaxing NPIs. We estimated the resulting number of daily infections and hospital admissions, and daily and cumulative deaths. Three scenarios spanning a range of optimistic to pessimistic vaccine effectiveness, waning natural immunity, and cross-protection from previous infections were investigated. We also considered three levels of mixing after the lifting of restrictions. FINDINGS: The roadmap policy was successful in offsetting the increased transmission resulting from lifting NPIs starting on March 8, 2021, with increasing population immunity through vaccination. However, because of the emergence of the delta variant, with an estimated transmission advantage of 76% (95% credible interval [95% CrI] 69-83) over alpha, fully lifting NPIs on June 21, 2021, as originally planned might have led to 3900 (95% CrI 1500-5700) peak daily hospital admissions under our central parameter scenario. Delaying until July 19, 2021, reduced peak hospital admissions by three fold to 1400 (95% CrI 700-1700) per day. There was substantial uncertainty in the epidemic trajectory, with particular sensitivity to the transmissibility of delta, level of mixing, and estimates of vaccine effectiveness. INTERPRETATION: Our findings show that the risk of a large wave of COVID-19 hospital admissions resulting from lifting NPIs can be substantially mitigated if the timing of NPI relaxation is carefully balanced against vaccination coverage. However, with the delta variant, it might not be possible to fully lift NPIs without a third wave of hospital admissions and deaths, even if vaccination coverage is high. Variants of concern, their transmissibility, vaccine uptake, and vaccine effectiveness must be carefully monitored as countries relax pandemic control measures. FUNDING: National Institute for Health Research, UK Medical Research Council, Wellcome Trust, and UK Foreign, Commonwealth and Development Office.

The impact of the COVID-19 pandemic on patterns of attendance at emergency departments in two large London hospitals: an observational study.

BACKGROUND: Hospitals in England have undergone considerable change to address the surge in demand imposed by the COVID-19 pandemic. The impact of this on emergency department (ED) attendances is unknown, especially for non-COVID-19 related emergencies. METHODS: This analysis is an observational study of ED attendances at the Imperial College Healthcare NHS Trust (ICHNT). We calibrated auto-regressive integrated moving average time-series models of ED attendances using historic (2015-2019) data. Forecasted trends were compared to present year ICHNT data for the period between March 12, 2020 (when England implemented the first COVID-19 public health measure) and May 31, 2020. We compared ICHTN trends with publicly available regional and national data. Lastly, we compared hospital admissions made via the ED and in-hospital mortality at ICHNT during the present year to the historic 5-year average. RESULTS: ED attendances at ICHNT decreased by 35% during the period after the first lockdown was imposed on March 12, 2020 and before May 31, 2020, reflecting broader trends seen for ED attendances across all England regions, which fell by approximately 50% for the same time frame. For ICHNT, the decrease in attendances was mainly amongst those aged < 65 years and those arriving by their own means (e.g. personal or public transport) and not correlated with any of the spatial dependencies analysed such as increasing distance from postcode of residence to the hospital. Emergency admissions of patients without COVID-19 after March 12, 2020 fell by 48%; we did not observe a significant change to the crude mortality risk in patients without COVID-19 (RR 1.13, 95%CI 0.94-1.37, p = 0.19). CONCLUSIONS: Our study findings reflect broader trends seen across England and give an indication how emergency healthcare seeking has drastically changed. At ICHNT, we find that a larger proportion arrived by ambulance and that hospitalisation outcomes of patients without COVID-19 did not differ from previous years. The extent to which these findings relate to ED avoidance behaviours compared to having sought alternative emergency health services outside of hospital remains unknown. National analyses and strategies to streamline emergency services in England going forward are urgently needed.

Key epidemiological drivers and impact of interventions in the 2020 SARS-CoV-2 epidemic in England.

We fitted a model of SARS-CoV-2 transmission in care homes and the community to regional surveillance data for England. Compared with other approaches, our model provides a synthesis of multiple surveillance data streams into a single coherent modeling framework, allowing transmission and severity to be disentangled from features of the surveillance system. Of the control measures implemented, only national lockdown brought the reproduction number (Rt eff) below 1 consistently; if introduced 1 week earlier, it could have reduced deaths in the first wave from an estimated 48,600 to 25,600 [95% credible interval (CrI): 15,900 to 38,400]. The infection fatality ratio decreased from 1.00% (95% CrI: 0.85 to 1.21%) to 0.79% (95% CrI: 0.63 to 0.99%), suggesting improved clinical care. The infection fatality ratio was higher in the elderly residing in care homes (23.3%, 95% CrI: 14.7 to 35.2%) than those residing in the community (7.9%, 95% CrI: 5.9 to 10.3%). On 2 December 2020, England was still far from herd immunity, with regional cumulative infection incidence between 7.6% (95% CrI: 5.4 to 10.2%) and 22.3% (95% CrI: 19.4 to 25.4%) of the population. Therefore, any vaccination campaign will need to achieve high coverage and a high degree of protection in vaccinated individuals to allow nonpharmaceutical interventions to be lifted without a resurgence of transmission.

The J-IDEA Pandemic Planner: A Framework for Implementing Hospital Provision Interventions During the COVID-19 Pandemic.

BACKGROUND: Planning for extreme surges in demand for hospital care of patients requiring urgent life-saving treatment for coronavirus disease 2019 (COVID-19), while retaining capacity for other emergency conditions, is one of the most challenging tasks faced by health care providers and policymakers during the pandemic. Health systems must be well-prepared to cope with large and sudden changes in demand by implementing interventions to ensure adequate access to care. We developed the first planning tool for the COVID-19 pandemic to account for how hospital provision interventions (such as cancelling elective surgery, setting up field hospitals, or hiring retired staff) will affect the capacity of hospitals to provide life-saving care. METHODS: We conducted a review of interventions implemented or considered in 12 European countries in March to April 2020, an evaluation of their impact on capacity, and a review of key parameters in the care of COVID-19 patients. This information was used to develop a planner capable of estimating the impact of specific interventions on doctors, nurses, beds, and respiratory support equipment. We applied this to a scenario-based case study of 1 intervention, the set-up of field hospitals in England, under varying levels of COVID-19 patients. RESULTS: The Abdul Latif Jameel Institute for Disease and Emergency Analytics pandemic planner is a hospital planning tool that allows hospital administrators, policymakers, and other decision-makers to calculate the amount of capacity in terms of beds, staff, and crucial medical equipment obtained by implementing the interventions. Flexible assumptions on baseline capacity, the number of hospitalizations, staff-to-beds ratios, and staff absences due to COVID-19 make the planner adaptable to multiple settings. The results of the case study show that while field hospitals alleviate the burden on the number of beds available, this intervention is futile unless the deficit of critical care nurses is addressed first. DISCUSSION: The tool supports decision-makers in delivering a fast and effective response to the pandemic. The unique contribution of the planner is that it allows users to compare the impact of interventions that change some or all inputs.

Characteristics and outcomes of clinically diagnosed RT-PCR swab negative COVID-19: a retrospective cohort study.

Patients with strong clinical features of COVID-19 with negative real time polymerase chain reaction (RT-PCR) SARS-CoV-2 testing are not currently included in official statistics. The scale, characteristics and clinical relevance of this group are not well described. We performed a retrospective cohort study in two large London hospitals to characterize the demographic, clinical, and hospitalization outcome characteristics of swab-negative clinical COVID-19 patients. We found 1 in 5 patients with a negative swab and clinical suspicion of COVID-19 received a clinical diagnosis of COVID-19 within clinical documentation, discharge summary or death certificate. We compared this group to a similar swab positive cohort and found similar demographic composition, symptomology and laboratory findings. Swab-negative clinical COVID-19 patients had better outcomes, with shorter length of hospital stay, reduced need for > 60% supplementary oxygen and reduced mortality. Patients with strong clinical features of COVID-19 that are swab-negative are a common clinical challenge. Health systems must recognize and plan for the management of swab-negative patients in their COVID-19 clinical management, infection control policies and epidemiological assessments.

Adapting hospital capacity to meet changing demands during the COVID-19 pandemic.

BACKGROUND: To calculate hospital surge capacity, achieved via hospital provision interventions implemented for the emergency treatment of coronavirus disease 2019 (COVID-19) and other patients through March to May 2020; to evaluate the conditions for admitting patients for elective surgery under varying admission levels of COVID-19 patients. METHODS: We analysed National Health Service (NHS) datasets and literature reviews to estimate hospital care capacity before the pandemic (pre-pandemic baseline) and to quantify the impact of interventions (cancellation of elective surgery, field hospitals, use of private hospitals, deployment of former medical staff and deployment of newly qualified medical staff) for treatment of adult COVID-19 patients, focusing on general and acute (G&A) and critical care (CC) beds, staff and ventilators. RESULTS: NHS England would not have had sufficient capacity to treat all COVID-19 and other patients in March and April 2020 without the hospital provision interventions, which alleviated significant shortfalls in CC nurses, CC and G&A beds and CC junior doctors. All elective surgery can be conducted at normal pre-pandemic levels provided the other interventions are sustained, but only if the daily number of COVID-19 patients occupying CC beds is not greater than 1550 in the whole of England. If the other interventions are not maintained, then elective surgery can only be conducted if the number of COVID-19 patients occupying CC beds is not greater than 320. However, there is greater national capacity to treat G&A patients: without interventions, it takes almost 10,000 G&A COVID-19 patients before any G&A elective patients would be unable to be accommodated. CONCLUSIONS: Unless COVID-19 hospitalisations drop to low levels, there is a continued need to enhance critical care capacity in England with field hospitals, use of private hospitals or deployment of former and newly qualified medical staff to allow some or all elective surgery to take place.